Efficient color mapping systems and methods

ABSTRACT

An electronic device may include a display panel with pixels that present an image based on image data and an application processor that generates the image data. The electronic device may include a display pipeline coupled to the electronic display and the application processor. The display pipeline may receive first image data from the application processor corresponding to a first color space used by the application processor. The display pipeline may apply a color mapping relationship to the first image data to generate second image data. The color mapping relationship may define a transform to apply to the first image data to generate the second image data corresponding to a second color space used by the electronic display. The display pipeline may transmit the second image data to a display driver that operates the electronic display to emit light according to the second image data.

BACKGROUND

The present disclosure relates generally to image processing and, moreparticularly, to efficiently color mapping image data for display on anelectronic display.

This section is intended to introduce the reader to various aspects ofart that may be related to various aspects of the present disclosure,which are described and/or claimed below. This discussion is believed tobe helpful in providing the reader with background information tofacilitate a better understanding of the various aspects of the presentdisclosure. Accordingly, it should be understood that these statementsare to be read in this light, and not as admissions of prior art.

Electronic devices often use one or more electronic displays to presenttext, still images, and/or video by displaying one or more image framesin sequence. For example, such electronic devices may include computers,mobile phones, portable media devices, tablets, televisions,virtual-reality headsets, and vehicle dashboards, among many others. Inany case, to display an image, an electronic display may control lightemission (e.g., luminance) of its display pixels based at least in parton corresponding image data.

In some instances, the electronic device may process image data usedwhen presenting the one or more images. When processing the image data,certain complex color transforms may be used to improve color imagequality, such as when changes in color gamut occur between generation ofthe image data (e.g., at an image source) and presentation of the imagedata (e.g., at a display). In some cases, three-dimensional (3D) colorlookup tables (3D CLUTs) may be used in an image-processing integratedcircuit device of the electronic device to perform complex colortransforms. However, a 3D CLUT may not be able to make fine adjustmentsto specific regions. Moreover, a 3D CLUT may take up a substantialamount of die space and/memory of an integrated circuit device. This maybe of particularly concern for wearable and/or portable electronicdevices with batteries that store a finite amount of electrical energyand/or have a finite amount of die space.

SUMMARY

A summary of certain embodiments disclosed herein is set forth below. Itshould be understood that these aspects are presented merely to providethe reader with a brief summary of these certain embodiments and thatthese aspects are not intended to limit the scope of this disclosure.Indeed, this disclosure may encompass a variety of aspects that may notbe set forth below.

An electronic device may include a display pipeline that processes imagedata to improve the perceived image quality of image frames presentedusing the image data. The image processing circuitry of the electronicdevice may include a color gamut mapping block (e.g., gamut mappingblock). The color gamut mapping block may use mapping relationships(e.g., color mapping relationships) to transform image data from anoriginal color space to another color space. In this way, the colorgamut mapping block may be more efficient than other ways to perform thetransformation, such as a three-dimensional color look-up table (3DCLUT). For example, a 3D CLUT may define, for each color value, how thecolor in a first color space is to be represented equivalently (e.g.,perceivably indistinct) in a second color space. As may be appreciated,the 3D CLUT may be stored in relatively large amounts of memory. Bycontrast, the color mapping relationships of this disclosure may involvea comparably smaller amount of memory.

Indeed, the color mapping relationships of this disclosure may define atransform between color spaces using an input/output relationshipdefinition (as opposed to storing multiple individual data pointsdirectly indicative of the transform). For example, the color mappingrelationships of this disclosure may define corrections applied to imagedata A in a first color space to obtain image data B in a second colorspace. Storing a color mapping relationship may use fewer memoryresources since the color mapping relationship may be defined by arelatively smaller number of variables to define transformationmatrices, coefficients, or the like of the color mapping relationship.Storing this relatively small number of variables uses less memory inrelation to storing an entire look-up table for each color valueconversion.

When applying the color mapping relationship, the color gamut mappingblock may retrieve the variables from memory and apply the variables toa color mapping relationship function format to derive the color mappingrelationship for the color space. For example, if the color mappingrelationship were to be an affine relationship between the first colorspace data (x) and the second color space (y), the color gamut mappingblock may access a color mapping relationship function like y=Ax+b andaccess from memory the variables for transformation matrix (A) andoffsets (b). Then, to obtain the image data in the second color space,the color gamut mapping block may apply the first color space data (x)to the color mapping relationship function (now particularly defined byvariables retrieved from memory) to obtain the second color space data(y). Indeed, the color mapping relationship may generate an output afterapplying the variables to the input without applying an interpolationbetween data points stored in a look-up table to derive the value.

Sometimes color space transforms use a hybrid color space asintermediate color spaces, such that the color relationship of input andoutput image data is defined in such intermediate color spaces to enablethe transform between the one or more color spaces. For example, thecolor gamut mapping block may receive image data according to ared-green-blue (RGB) color space (e.g., first color space). The colorgamut mapping block may transform the image data to a luminance-firstchroma component-second chroma component (YCbCr) color space (e.g.,hybrid color space, third color space) before transforming the imagedata to the second color space. The intermediate color spaces may berelatively perceptually uniform, and their axes are defined withperceptual meaningful quantities such as luminance and chroma, toimprove color transformation quality. Indeed, in some cases it may bedesirable to apply transforms (e.g., affine relationship) while imagedata is formatted according to the intermediate color space, since doingso may improve perceived uniformity of resulting images generated usingtransformed image data. Furthermore, the transformation may involveusing regionally defined color mapping relationships with or without useof the hybrid color space.

The color gamut in the color space of an output display device may bedivided into sub-spaces, and each sub-space may correspond to differentcolor relationships relative to the color space of the image source.Thus, each sub-space may each correspond to different transforms used toconvert the color space of the image source to the color space of thedisplay device. Since these conversions may be performed with or withoutuse of the hybrid color space (e.g., intermediate color space), thetransform may consider the hybrid color space or may not consider thehybrid color space. In either case, however, one or more color spacesare divided into sub-spaces, and different color relationships may bedefined for each sub-spaces.

For example, the color gamut mapping block may sub-divide the inputcolor gamut into regions (e.g., sub-spaces). As an example, a respectiveinput color value from the set of input image data may correspond (e.g.,fall into) to one of the sub-spaces, and thus may have the colortransformation relationship defined in that sub-space applied whenconverting the input color value to an output color value compatiblewith the color space of the display device. Each sub-space may definedifferent transforms that, collectively, may produce an overalltransform that is relatively complex over the entire color space. Yeteach sub-space may define a comparatively simple transform, such asaffine transformation. By carefully defining each of the sub-spaces andsub-space transforms, a complex transform, such as a nonlineartransform, may be achieved when considering the whole input color gamutcombining all sub-spaces. Furthermore, even a color gamut mapping blockapplying regionally-defined color mapping relationships may use less diespace or memory than a 3D CLUT.

The color transform relationships in each sub-space may be defined suchthat the output color gamut is still continuous across sub-spaces. Forexample, the color value that resides on the boundary of two adjacentsub-spaces A and B, may be adjusted by either color relationshipcorresponding to sub-space A or sub-space B, and result the same outputcolor value. A default rule may be defined to handle these boundarycases. For example, each time the boundary value is encountered, thetransformation applied corresponds to sub-space A as opposed tosub-space B, or vice versa.

The color gamut mapping block may involve an efficient sub-space searchprocess. An efficient sub-space search algorithm may identify whichsub-space input color data resides in to apply the transformrelationship associated with the sub-space. One search method may be abinary tree space search method, where the sub-spaces are arranged in abinary tree based on the spatial relationships between the sub-spacesinside the input color space. The spatial relationships may organizevalues different between each sub-space such that sub-spacescorresponding to respective color values of the input image data may beidentified by iterative searching of the binary tree. Indeed, in thebinary tree search space method, image data may be matched over severaliterations of searching through the binary tree, such that when a higherlevel match is found, further portions of the image data are compared tothe binary tree to identify which sub-space particular image datacorresponds to without having to search each sub-space condition in itsrespective entirety.

Various refinements of the features noted above may exist in relation tovarious aspects of the present disclosure. Further features may also beincorporated in these various aspects as well. These refinements andadditional features may exist individually or in any combination. Forinstance, various features discussed below in relation to one or more ofthe illustrated embodiments may be incorporated into any of theabove-described aspects of the present disclosure alone or in anycombination. The brief summary presented above is intended only tofamiliarize the reader with certain aspects and contexts of embodimentsof the present disclosure without limitation to the claimed subjectmatter.

BRIEF DESCRIPTION OF THE DRAWINGS

Various aspects of this disclosure may be better understood upon readingthe following detailed description and upon reference to the drawings inwhich:

FIG. 1 is a block diagram of an electronic device with an electronicdisplay, in accordance with an embodiment;

FIG. 2 is an example of the electronic device of FIG. 1, in accordancewith an embodiment;

FIG. 3 is another example of the electronic device of FIG. 1, inaccordance with an embodiment;

FIG. 4 is another example of the electronic device of FIG. 1, inaccordance with an embodiment;

FIG. 5 is another example of the electronic device of FIG. 1, inaccordance with an embodiment;

FIG. 6 is a block diagram of a portion of the electronic device of FIG.1 including an application processor and a display pipeline, inaccordance with an embodiment;

FIG. 7 is a block diagram of operations performed on input image data bya gamut mapping block of the display pipeline of FIG. 6, in accordancewith an embodiment.

FIG. 8 is a flow diagram of a process for processing input image datareceived at a gamut mapping block of FIG. 7, in accordance with anembodiment;

FIG. 9 is a diagrammatic representation of operations performed by thegamut mapping block of FIG. 7, in accordance with an embodiment; and

FIG. 10 is a diagrammatic representation of another example ofoperations performed by the gamut mapping block of FIG. 7, in accordancewith an embodiment.

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS

One or more specific embodiments will be described below. In an effortto provide a concise description of these embodiments, not all featuresof an actual implementation are described in the specification. Itshould be appreciated that in the development of any such actualimplementation, as in any engineering or design project, numerousimplementation-specific decisions are made to achieve the developers'specific goals, such as compliance with system-related andbusiness-related constraints, which may vary from one implementation toanother. Moreover, it should be appreciated that such a developmenteffort might be complex and time consuming, but would nevertheless be aroutine undertaking of design, fabrication, and manufacture for those ofordinary skill having the benefit of this disclosure.

When introducing elements of various embodiments of the presentdisclosure, the articles “a,” “an,” and “the” are intended to mean thatthere are one or more of the elements. The terms “comprising,”“including,” and “having” are intended to be inclusive and mean thatthere may be additional elements other than the listed elements.Additionally, it should be understood that references to “oneembodiment” or “an embodiment” of the present disclosure are notintended to be interpreted as excluding the existence of additionalembodiments that also incorporate the recited features. Furthermore, thephrase A “based on” B is intended to mean that A is at least partiallybased on B. Moreover, the term “or” is intended to be inclusive (e.g.,logical OR) and not exclusive (e.g., logical XOR). In other words, thephrase A “or” B is intended to mean A, B, or both A and B.

An electronic device may include components that, in operation, consumeelectrical power. For example, electronic devices may include circuitry(e.g., image source, application processor) that render image frames bygenerating corresponding image data. Electronic devices may also includea display pipeline that processes the image data before the image datais used to display the image frame on an electronic display. Theprocessing of the image data may improve the perceived image quality ofthe image frame.

Based at least in part on received image data, the electronic displaymay control light emission (e.g., luminance) of its display pixels topresent a corresponding image frame. For example, in a liquid crystaldisplay (LCD), electrical energy may be stored in the pixel electrode ofa display pixel to produce an electric field between the pixel electrodeand a common electrode, which controls orientation of liquid crystalsand, thus, light emission from the display pixel. Additionally, in anorganic light-emitting diode (OLED) display, electrical energy may bestored in a storage capacitor of a display pixel to control electricalpower (e.g., current) supplied to a self-emissive component (e.g., OLED)and, thus, light emission from the display pixel. However, electronicdevices, such as wearable or portable electronic devices, often store afinite amount of electrical energy.

Accordingly, the present disclosure provides techniques for transformingcolor spaces using a color gamut mapping block. The gamut mapping blockmay enable the display pipeline to make fine adjustments to specificcolors of image data and/or reducing an amount of physical space and/orlogical space used to provide the image processing circuitry.Furthermore, the gamut mapping block may provide some advantages over a3D CLUT when used to perform some processing of display pipeline; forexample, the gamut mapping block may use color mapping relationshipsthat are able to be stored using relatively less space in memory.

Indeed, the color gamut mapping block may receive image data in a firstcolor space for transformation to image data of a second color space.The color gamut mapping block may use a hybrid color space whenperforming the transform. When the data is in the hybrid color space,the color gamut mapping block may transform the color based onpredefined color transformation relationships. The second color space,where the relationship is defined, may be divided into sub-spaces, anddifferent color relationships may be defined for each sub-space. Sinceeach sub-space may be associated with a different transform (e.g.,respectively defined transform that may include the same or differenttransforms), each sub-space may define a relatively simple transform,such as affine transformation, and by carefully define sub-spaces andsub-space transforms, a complex transform, such as a nonlineartransform, may be achieved considering the whole input color gamutcombining all sub-spaces.

The color gamut mapping block may, in some cases, divide the color spaceitself into regions, and perform the color space transformations overthe color space regions. The gamut mapping block may generate a colormapping relationship for the first color space to convert image datafrom the first color space to the second color space. However, the colormapping relationship may better transform between color spaces forsmaller regions of the color space as opposed to a mapping relationshipof the color spaces as a whole. As one may appreciate, it is generallymore efficient to generate a linear and/or non-linear relationship for asmaller set of data and/or for data with fewer outliers (and/or lessvariance) than for a dataset that is larger and/or one with moreoutliers. Thus, the color mapping relationship may be more efficientlygenerated since less computing resources may be used when the gamutmapping block generates the color mapping relationship for each regionseparately (and/or separately and in parallel, and/or separately andhaving a same start time). Region-based mapping may also improve mappingoperations since equation roots are sometimes determined when generatingthe color mapping relationship (e.g., slopes and/or characteristics) maybe faster to converge, and thus less resource-intensive, when determinedfor each of the various regions relative to performing the same colormapping relationship determination for the entire cube (e.g., entirecolor space).

It is noted that at the output from the color gamut mapping block, acertain amount of truncation of data may occur to help fit the output toa future input. This may involve a transformation of a hexadecimal valuefrom a first length to a second length. Any suitable amount of data maybe added to the image data before processing by the color gamut mappingblock and/or any suitable amount of data may be truncated from the imagedata after processing from the color gamut mapping block.

To help illustrate, an electronic device 10 including an electronicdisplay 12 (e.g., display device) is shown in FIG. 1. As is described inmore detail below, the electronic device 10 may be any suitableelectronic device, such as a computer, a mobile phone, a portable mediadevice, a tablet, a television, a virtual-reality headset, a vehicledashboard, and the like. Thus, it should be noted that FIG. 1 is merelyone example of a particular implementation and is intended to illustratethe types of components that may be present in an electronic device 10.

The electronic display 12 may be any suitable electronic display. Forexample, the electronic display 12 may include a self-emissive pixelarray having an array of one or more of self-emissive pixels. Theelectronic display 12 may include any suitable circuitry to drive theself-emissive pixels, including for example row driver and/or columndrivers (e.g., display drivers). Each of the self-emissive pixel 82 mayinclude any suitable light emitting element, such as a LED, one exampleof which is an OLED. However, any other suitable type of pixel,including non-self-emissive pixels (e.g., liquid crystal as used inliquid crystal displays (LCDs), digital micromirror devices (DMD) usedin DMD displays) may also be used.

In the depicted embodiment, the electronic device 10 includes theelectronic display 12, one or more input devices 14, one or moreinput/output (I/O) ports 16, a processor core complex 18 having one ormore processor(s) or processor cores, local memory 20, a main memorystorage device 22, a network interface 24, a power source 26 (e.g.,power supply), and image processing circuitry 28. The various componentsdescribed in FIG. 1 may include hardware elements (e.g., circuitry),software elements (e.g., a tangible, non-transitory computer-readablemedium storing instructions), or a combination of both hardware andsoftware elements. It should be noted that the various depictedcomponents may be combined into fewer components or separated intoadditional components. For example, the local memory 20 and the mainmemory storage device 22 may be included in a single component. Theimage processing circuitry 28 (e.g., a graphics processing unit) may beincluded in the processor core complex 18.

As depicted, the processor core complex 18 is operably coupled withlocal memory 20 and the main memory storage device 22. Thus, theprocessor core complex 18 may execute instruction stored in local memory20 and/or the main memory storage device 22 to perform operations, suchas generating and/or transmitting image data. As such, the processorcore complex 18 may include one or more general purpose microprocessors,one or more application specific integrated circuits (ASICs), one ormore field programmable logic arrays (FPGAs), or any combinationthereof.

In addition to instructions, the local memory 20 and/or the main memorystorage device 22 may store data to be processed by the processor corecomplex 18. Thus, the local memory 20 and/or the main memory storagedevice 22 may include one or more tangible, non-transitory,computer-readable mediums. For example, the local memory 20 may includerandom access memory (RAM) and the main memory storage device 22 mayinclude read-only memory (ROM), rewritable non-volatile memory such asflash memory, hard drives, optical discs, and/or the like.

As depicted, the processor core complex 18 is also operably coupled withthe network interface 24. The network interface 24 may communicate datawith another electronic device and/or a network. For example, thenetwork interface 24 (e.g., a radio frequency system) may enable theelectronic device 10 to communicatively couple to a personal areanetwork (PAN), such as a Bluetooth network, a local area network (LAN),such as an 1622.11x Wi-Fi network, and/or a wide area network (WAN),such as a 4G or Long-Term Evolution (LTE) cellular network.

The processor core complex 18 is operably coupled to the power source26. The power source 26 may provide electrical power to one or morecomponents in the electronic device 10, such as the processor corecomplex 18 and/or the electronic display 12. Thus, the power source 26may include any suitable source of energy, such as a rechargeablelithium polymer (Li-poly) battery and/or an alternating current (AC)power converter.

The processor core complex 18 is operably coupled with the one or moreI/O ports 16. The I/O ports 16 may enable the electronic device 10 tointerface with other electronic devices. For example, when a portablestorage device is connected, the I/O port 16 may enable the processorcore complex 18 to communicate data with the portable storage device.

The electronic device 10 is also operably coupled with the one or moreinput devices 14. The input device 14 may enable user interaction withthe electronic device 10, for example, by receiving user inputs via abutton, a keyboard, a mouse, a trackpad, and/or the like. The inputdevice 14 may include touch-sensing components in the electronic display12. The touch sensing components may receive user inputs by detectingoccurrence and/or position of an object touching the surface of theelectronic display 12.

In addition to enabling user inputs, the electronic display 12 mayinclude a display panel with one or more display pixels. The electronicdisplay 12 may control light emission from the display pixels to presentvisual representations of information, such as a graphical userinterface (GUI) of an operating system, an application interface, astill image, or video content, by displaying frames based at least inpart on corresponding image data. As depicted, the electronic display 12is operably coupled to the processor core complex 18 and the imageprocessing circuitry 28. In this manner, the electronic display 12 maydisplay frames based at least in part on image data generated by theprocessor core complex 18, the image processing circuitry 28.Additionally or alternatively, the electronic display 12 may displayframes based at least in part on image data received via the networkinterface 24, an input device, and/or an I/O port 16.

As described above, the electronic device 10 may be any suitableelectronic device. To help illustrate, an example of the electronicdevice 10, a handheld device 10A, is shown in FIG. 2. The handhelddevice 10A may be a portable phone, a media player, a personal dataorganizer, a handheld game platform, and/or the like. For illustrativepurposes, the handheld device 10A may be a smart phone, such as anyIPHONE® model available from Apple Inc.

The handheld device 10A includes an enclosure 30 (e.g., housing). Theenclosure 30 may protect interior components from physical damage and/orshield them from electromagnetic interference, such as by surroundingthe electronic display 12. The electronic display 12 may display agraphical user interface (GUI) 32 having an array of icons. When an icon34 is selected either by an input device 14 or a touch-sensing componentof the electronic display 12, an application program may launch.

The input devices 14 may be accessed through openings in the enclosure30. The input devices 14 may enable a user to interact with the handhelddevice 10A. For example, the input devices 14 may enable the user toactivate or deactivate the handheld device 10A, navigate a userinterface to a home screen, navigate a user interface to auser-configurable application screen, activate a voice-recognitionfeature, provide volume control, and/or toggle between vibrate and ringmodes. The I/O ports 16 may be accessed through openings in theenclosure 30 and may include, for example, an audio jack to connect toexternal devices.

Another example of a suitable electronic device 10, specifically atablet device 10B, is shown in FIG. 3. The tablet device 10B may be anyIPAD® model available from Apple Inc. A further example of a suitableelectronic device 10, specifically a computer 10C, is shown in FIG. 4.For illustrative purposes, the computer 10C may be any MACBOOK® or IMAC®model available from Apple Inc. Another example of a suitable electronicdevice 10, specifically a watch 10D, is shown in FIG. 5. Forillustrative purposes, the watch 10D may be any APPLE WATCH® modelavailable from Apple Inc. As depicted, the tablet device 10B, thecomputer 10C, and the watch 10D each also includes an electronic display12, input devices 14, I/O ports 16, and an enclosure 30. The electronicdisplay 12 may display a GUI 32. Here, the GUI 32 shows a visualizationof a clock. When the visualization is selected either by the inputdevice 14 or a touch-sensing component of the electronic display 12, anapplication program may launch, such as to transition the GUI 32 topresenting the icons 34 discussed in FIGS. 2 and 3.

Operating an electronic device 10 to communicate information bydisplaying images on its electronic display 12 generally consumeselectrical power. The electronic device 10 often stores a finite amountof electrical energy. An image processing system 36 that includes adisplay pipeline 38, which may be implemented in an electronic device10, is shown in FIG. 6. As depicted, the image processing system 36 alsoincludes an external memory 40 (e.g., local memory 20), a display driver42, and a system controller 44, which may be implemented in anelectronic display 12. The system controller 44 may control operationsof the display pipeline 38, the external memory 40, the display driver42, and/or other portions of the electronic device 10. It is noted thatthe display pipeline 38 may include control circuitry, such as controlcircuitry similar to the system controller 44 but particular tomanagement of communication between components of the display pipeline38 (e.g., between image processing and/or configuration blocks).

The system controller 44 may include a controller processor 48 andcontroller memory 50. The controller processor 48 may executeinstructions stored in the controller memory 50. The controllerprocessor 48 may be included in the processor core complex 18, the imageprocessing circuitry 28, a timing controller in the electronic display12, a separate processing module, or any combination thereof. Thecontroller memory 50 may be included in local memory 20, the main memorystorage device 22, external memory 40, internal memory of a displaypipeline 38, a separate tangible, non-transitory, computer readablemedium, or any combination thereof. Although depicted as a systemcontroller 44, in some cases, several separate system controllers 44 maybe implemented to control operation of the electronic device.

The display pipeline 38 may operate to process image data to improveperceived image quality of a resulting image presented on the electronicdisplay 12. An application processor 52 generates and stores the imagedata in the external memory 40 for access by the display pipeline 38.The display pipeline 38 may be implemented via circuitry, for example,packaged as a system-on-chip (SoC). The display pipeline 38 may beincluded in the processor core complex 18, the image processingcircuitry 28, a timing controller (TCON) in the electronic display 12,other one or more processing units, other processing circuitry, or anycombination thereof.

The display pipeline 38 may include a direct memory access (DMA) block64, a configuration buffer 66, an output buffer 68, and one or moreimage data processing blocks 46 (e.g., a processing block 70 and a gamutmapping block 72). The various blocks of the display pipeline 38 may beimplemented using circuitry and/or programmable instructions executed bya processor. The display pipeline 38 may retrieve image data from theexternal memory 40 and may process the image data before transmission tothe display driver 42. The processing block 70 and the gamut mappingblock 72 may perform process the retrieved image data to try to make theretrieved image data more suitable for presentation. The image data maybe processed to compensation or adjust the perceivable appearance ofimage based on current operating and/or environmental conditions, suchas to adjust the image data depending on the color or brightness ofambient light.

Indeed, color values of images to be represented by the image data maybe mapped to image reproduction configurations of an output device(e.g., the electronic display 12). This may be especially true for animage reproduction system that generates image data for transmission tothe output device. For example, a photographic printer, a photolaboratory, a monitor, a printer, a color laser printer, an inkjetprinter, a second electronic device, an image source may each beconsidered image reproduction systems. A color space of the device isreferred to as color gamut of the device. The color gamut of the imagecapturing device (e.g., image source) may include each color values ableto be captured and output by the image capturing device. The image dataoutput by the image capturing device may not totally reflect the colorgamut of the output device, and thus the gamut mapping block 72 mayperform a transform to translate a color gamut (e.g., color space) ofthe image capturing device (or image source) into a color gamut (e.g.,color space) of the output device (e.g., electronic display 12).Furthermore, the processing block 70 may perform additional operationsto adjust the image data received by the display pipeline 38 to besuitable for presentation. For example, the processing block 70 mayadjust a brightness level of the image data based on a brightness levelof ambient light and/or may adjust a white point of the image data basedon a white point of a color of the ambient light sensed by a sensorcommunicating with the application processor 52.

FIG. 7 is a block diagram of operations performed by the gamut mappingblock 72 on input image data 90. The gamut mapping block 72 may generateoutput image data 92 corrected of at least some color space-relateddifferences between a source (e.g., image source) of the input imagedata 90 and the electronic display 12.

Indeed, a color space may generally refer to a specific organization ofcolors in combination with a configuration and/or profile of anelectronic display 12 (or an electronic device 10). A color space mayfacilitate repeatable conversion of image data generated by a firstdevice to emitted light perceivable from a second device. Correction ofthe color space-related differences may improve operation of theelectronic device 10 by improving a perceivable quality of imagepresented on the electronic display 12.

Improving the perceivable quality of image displayed may involvereducing amounts of perceivable visual artifacts. Visual artifacts maybe generated when a different color space is used to present image datathan a color space used by an image source to generate the image data.For example, when an image source or image reproduction device generatesthe image data according to a first color space different from a secondcolor space of the electronic display 12, perceivable visual artifactsmay be presented with the image frame and/or the image frame may bemisrepresented in presentation (e.g., wrong color, wrong brightnesslevel, distortion in images presented). The misrepresentation may bepresent when a color gamut is converted to another smaller color gamutand the out-of-gamut values are clipped. Gamut color mapping may beperformed to remedy the color space differences and to improvepresentation of images, such as by improving consistency between imagedata generation and image data presentation and/or by reducingperceivable visual artifacts. When color space differences areconsidered, color gamut mapping may be performed such that out-of-gamutvalues are considered and/or included as part of output datapost-conversion, as opposed to being clipped (e.g., discarded,unconsidered).

Indeed, using the systems and methods described herein for color gamutmapping, quality of images presented to operators with abnormal oratypical color vision (e.g., color blindness, color vision deficiencies(CVD)) may improve in perceivable quality (e.g., become more uniform).Improving the perceived quality of image displayed for people withabnormal color vision may involve transforming an input color gamut toan output color gamut using nonlinear distortion of colors, such as hueshift and luminance adjustment, applied to a subset of color regionsthat are to be adjusted to help people with abnormal color vision toread color information on displays. By reducing a scope of theadjustment to the subset of color regions to be adjusted, relativelyhigh quality color images may be generated by adjusting the portions tobe adjusted of the image data and by maintaining color gradients,natural colors, and color space regions where the portions of image datamay be left unchanged. Selectively applying transforms as suggestedherein may improve image quality when compared to image data generatedby applying a global color transformation on a whole color space withoutapplying the transformations via sub-spaces.

The display pipeline 38 may include a gamut mapping block 72 to performgamut color mapping operations, such as the gamut color mappingoperations that involve the use of sub-spaces. The gamut mapping block72 may transform data generated according to a color space of a firstdevice (e.g., a first color space) to a color space of a second device(e.g., a third color space). The gamut mapping block 72 may use a hybridcolor space (e.g., second color space) or may operate in a bypass modeto bypass use of the hybrid color space. A transform that uses thehybrid color space is exemplified in FIG. 7, where the transform isrepresented as a series of color space transforms. For example, this maybe represented as a first conversion from the first color space to thesecond color space (e.g., hybrid color space), and then from the secondcolor space to the third color space. In this way, when a first devicepresents a first image frame having a first perceived appearance whenviewed by an operator, the gamut mapping block 72 may cause a seconddevice to present the same first image frame with the same firstperceived appearance (as opposed to a different, second perceivedappearance) when viewed by a same or different operator even when thesecond device has a different color space from the first device.

Sometimes performing a color space conversion on the input image data 90to generate the output image data 92 involves converting the input imagedata 90 from an original color space to a hybrid color space (e.g.,intermediate color space). The hybrid color space may be relativelyperceptually uniform, and the axes of the hybrid color space may bedefined with quantities such as luminance and chroma that are visible toa user (e.g., perceivable, perceptually meaningful), to improve colortransformation quality. Indeed, in some cases it may be desirable toapply transforms (e.g., the affine relationship) while image data isformatted according to the intermediate color space since doing so mayimprove the perceived uniformity of resulting images generated usingtransformed image data.

For example, the gamut mapping block 72 may receive the input image data90 in an original color space (e.g., a red-green-blue (RGB) color space,a first color space) and may, at block 94, convert the input image data90 to a hybrid color space (e.g., a second color space), which is alsoreferred to herein as a carrier color space. When using the hybrid colorspace, the color gamut mapping block 72 may transform the image data toa luminance-first chroma component-second chroma component (YCbCr) colorspace (e.g., hybrid color space, third color space) before transformingthe image data to the second color space, where a third-component (Cg)may not be included in the YCbCr representation (e.g., Cg may bederivable from YCbCr data points without having to be directlycomputed). When the input image data 90 is in the YCbCr color space, thegamut mapping block 72 may, at block 96, determine a transform (e.g., anadjustment) to be made to the input image data 90. Additionally oralternatively, the gamut mapping block 72 may sub-divide the input imagedata 90 into regions (e.g., regions based on color value of the imagedata). At block 98, the gamut mapping block 72 may apply the transformto the input image data 90 on a per-region basis, based on the sub-spaceof the output color space to which the input image data 90 corresponds.Respective transforms may be applied separately to regions of the inputimage data 90 having the same color value, or these transforms may beperformed at the same time and the resulting values propagated asappropriate through the output image datasets resulting from thetransform (e.g., yielding faster computations since fewer discretecomputations may be performed). The adjusted input image data 90 may, atblock 100, be transformed to an output color space (e.g., RGB) from thehybrid color space (e.g., YCbCr), and transmitted from the gamut mappingblock 72 for additional processing by the processing block 70 and/or fortransmission to the output buffer 68.

The color transform relationships in each sub-space may be defined suchthat the output color gamut is continuous across sub-spaces. Forexample, the color value that resides on the boundary of two adjacentsub-spaces A and B may be validly adjusted by either color relationshipcorresponding to sub-space A or sub-space B, and may result in the sameoutput color value. A default rule may be defined to handle theseboundary cases. For example, each time the boundary value isencountered, the transformation applied may correspond to sub-space A asopposed to sub-space B, or vice versa.

The color gamut mapping block 72 may involve, such as at block 96 withdetermining the transform, a sub-space search. A sub-space searchalgorithm may identify which sub-space the input color data resides into apply the transform relationship associated with that sub-space. Oneefficient search method may include a binary tree space search method,where the sub-spaces are arranged in a binary tree based on thesub-spaces' spatial relationships inside the input color space, so thatthe input data's sub-space may be searched iteratively by searching thebinary tree. In this way, for a target value of image data (e.g., imagedata for a pixel, image data for a region of pixels), a portion of thetarget value of image data may be compared with a portion of a datadefining the sub-space. This may be used to determine, after one or moreiterations, in which sub-space to classify the image data. This mayoccur iteratively as additional comparisons may be performed when amatch of smaller data occurs (e.g., to work through the tree branches asmatches are encountered).

When converting the input image data 90 from the RGB color space intothe YCbCr color space, at block 94, the three component values for theYCbCr space may be created from the original RGB (red, green and blue)color space image source. Indeed, image data may include various valuesrepresentative of signals used to drive components of the electronicdisplay 12 to render image frames (to present images on the electronicdisplay 12). The signals may be analog signals or digital signals usedto drive light-emitting devices of the electronic display 12 to presenta respective image frame. The presented image frame may be updated inresponse to components of the electronic display 12 receiving next imagedata for a subsequent image frame.

The input image data 90 may include data interpretable by the displaydriver 42 to drive the light-emitting devices of the electronic display12 to present the image frame in a color space. The color space of theelectronic display 12 may be such that each perceivable color renderedon the electronic display 12 is the result of a combined light emissionfrom multiple light-emitting devices. For example, the electronicdisplay 12 may use a red-green-blue (RGB) color space, where a pixel mayinclude a red component (R) subpixel, a blue component (B) subpixel, anda green component (G) subpixel. In one pixel, separate light emissionfrom the red component (R) subpixel, the blue component (B) subpixel,and the green component (G) subpixel may collectively cause the pixel toappear to emit light of a particular color in a particular color spacebased on respective R, B, and G values. Different displays 12 may havedifferent color spaces due to their different light-emitting components.

When converting the input image data 90 from a first color space to asecond color space, certain image data transforms may be performed. Inthe case of the conversion from the RGB color space to the YCbCr colorspace, for example, weighted values of the R value, the G value, and theB value may be added together in different combinations to generate thevalues used to form YCbCr color space image data. Although theprocessing of the gamut mapping block 72 is described as performed inthe YCbCr color space, it should be understood that in some cases thegamut mapping block 72 processes the images in the RGB color space(e.g., without a conversion), in a YCbCg (or YCrCg) color space, or thelike. Other color spaces may also benefit from the processing techniquesdescribed herein.

An example of a process 112 for processing the input image data 90received at the gamut mapping block 72 is described in FIG. 8. Theprocess 112 may be facilitated (e.g., controlled, implemented) byinstructions stored in a tangible, non-transitory, computer-readablemedium, such as external memory 40 or other memory, using a controllerof the processor core complex 18, such as a display pipeline controllerof the display pipeline 38. For ease of description, the process 112 isdescribed as performed by the gamut mapping block 72 (e.g., controlcircuitry of the gamut mapping block 72). It is noted that theoperations of the process 112 are shown in a particular order; however,some of the operations may be performed in a different order than whatis presented.

At block 114, the gamut mapping block 72 may receive input image data90. The input image data 90 may be received from the processing block 70and/or from the DMA block 64. The input image data 90 may include datain a RGB-based color space, such as a Standard Red Green Blue (sRGB)color space.

At block 116, the gamut mapping block 72 may convert input image data 90from a first color space (e.g., RGB color space) to a second color space(e.g., hybrid color space, YCbCr color space) using iterative processes.When converting the input image data 90 from the first color space intoa YCbCr color space, the three component values for the YCbCr colorspace may be created from the original RGB (red, green and blue) colorspace. The weighted values of R, G and B may be added together toproduce a single Y value, representing the overall brightness, orluminance, of that region. The Cb value is then created by subtractingthe Y from the blue value of the original RGB color space, and thenscaling. The Cr value by subtracting the Y from the red value, and thenscaling by a different factor. Although the processing of the gamutmapping block 72 is described as perform in the YCbCr color space, thegamut mapping block 72 may instead process the images in the RGB colorspace, in a YCbCg (or YCrCg) color space, or any other suitable colorspace.

Indeed, at block 116, the gamut mapping block 72 may also convert inputimage data into the hybrid color space (e.g., second color space) or asimilar color space using a division operation. The division operationmay use iterative processes, such as Newton-Raphson analysis, othersuitable analysis and/or root approximation operations, aniteration-based computation, or the like, to predict roots used in aformula applied to determine the divisions of input image data intosub-spaces of the output color space (e.g., output color gamut).

At block 118, the gamut mapping block 72 may classify the input imagedata into sub-spaces of the third color space. Indeed, a search may beperformed to determine which sub-space of the color space of the displaydevice 12 the input image data 90 resides within (e.g., to identify asub-space of the third color space). The gamut mapping block 72 maydetermine which sub-space of the third color space that the input imagedata formatted in the color gamut of the first color space resideswithin (e.g., within threshold values of) by considering ranges ofvalues corresponding to the sub-spaces. The search may involve a binarytree-based search that performs iterative matches over different depthsof a binary tree to determine which sub-space the input image data 90corresponds. A first sub-space of the third color space may correspondto a first range of color values and a second sub-space of the thirdcolor space may correspond to a different, second range of color values(e.g., non-overlapping with the first range of color values).Consideration of these ranges may help identify to which sub-space toassociate the particular color value being classified of the input imagedata 90. The transform may be determined to compensate for differencesbetween the first color space and the third color space, (e.g., thecolor space used by electronic display 12) based on the sub-spaceclassifications of the input image data 90. Indeed, each sub-space maycorrespond to a particular transform defined for the particularsub-space. When the transform is applied, the converted image data mayundergo value adjustments to change a color and/or gray level used forrespective portions of image data. It is noted that in some cases thesearch to place one or more values of the input image data 90 to one ormore sub-spaces of the color space may be performed using software andprovided to the gamut mapping block 72. At block 120, the gamut mappingblock 72 may determine the transform based on the sub-space determinedat block 118. The gamut mapping block 72 may have configurations ofcolor transforms defined differently in different sub-spaces of theinput color space, by dividing the entire input color space intosub-regions, which are also referred to as sub-spaces.

At block 122, the gamut mapping block 72 may apply the transformdetermined at block 120 to the input image data 90. The transformapplied is associated with the sub-space determined to correspond to theinput image data 90. Each respective sub-region may have a customadjustment applied to its particular values that overall results in theimplementation of the desired transform to the converted image data toconform to the color space of the display 12. Applying the transform mayinvolve using affine transformations that use a transformation matrixand offsets. These computations may benefit from the sub-regional-basedanalysis described herein.

The adjusted dataset may then be converted, at block 124, by the gamutmapping block 72 from the second color space to the third color space togenerate the output image data 92 using iterative processes (e.g.,inverse of previously applied iterative processes at block 116). Thegamut mapping block 72 may output the output image data 92 to theprocessing block 70 for further processing and/or the output buffer 68to be used to present an image frame on a display. It is noted thatcolor spaces may be based on RGB color values and still be differentcolor spaces, such as based on how differences between how particularpixels of the respective devices and/or respective color spaces are ableto emit light. For example, the first color space and the third colorspace may both be based on RGB color values that render and/or are usedto generate control signals to drive image presentation on theelectronic display 12 in different manners, and thus warrant gamutmapping to adjust for the differences in color spaces. Indeed, one colorspace may be suitable for expected human vision and another color spacemay be suitable for unexpected or atypical human vision (e.g., moresuitable for viewing by a user with color blindness or visionimpairments).

FIG. 9 is a diagrammatic representation of operations performed by thegamut mapping block 72 in a hybrid color space domain (e.g., usingvalues corresponding to a hybrid color space, or intermediary colorspace used for at least some forms of processing prior to presentationof the image data) to map a first color space to a second color space(e.g., first color space to hybrid color space to second color space).It should be understood that the processes represented by the diagram inFIG. 9 are simplified representations of the processing that isperformed by software and/or hardware components of the gamut mappingblock 72 (and/or of a display pipeline controller operating thecomponents of the gamut mapping block 72 via generation of controlsignals and/or commands), and that more or fewer operations may beperformed on the input image data 90.

As depicted, the input image data 90 is received by the gamut mappingblock 72 and processed at block 138 to generate hybrid color space dataassociated with respective sub-spaces of the output color space (e.g.,second color space). As described above, the input image data 90 iscompared to sub-spaces of the output color space to determine whichtransform to apply at block 142. The input image data 90 may correspondto image data generated according to the first color space. The gamutmapping block 72 may use a hybrid color space to process the input imagedata 90, and thus may convert the input image data 90 from the firstcolor space to the hybrid color space to perform mapping operations(e.g., translation operations). Indeed, the input image data 90 may beadjusted and/or used to generate intermediary image data of the hybridcolor space. In some cases, as a part of the first operation at portion138 (e.g., performed at a first time), the gamut mapping block 72 maydetermine regions 140 of the intermediary image data to organize thedata for the transform. Each region 140 may correspond to a respectivelyapplied transform, such as a transform for a particular color space thatthe image data associated with the region 140 corresponds. Transformsapplied to respective regions may be same (and thus may be a sametransform processed in parallel) and/or may be different. Each transformmay be determined prior to starting the transform and/or may be appliedas determined in a pipeline-format.

The regions 140 may be determined as equidistant and/or equal-sizedportions, such as by dividing a height and/or width of the total datasetby four, or some other value (e.g., 2, 3, 5, . . . , N), and/ortetrahedrons, triangle prisms, or other three-dimensional (3D) spacegeometry primitives. Here, there are four regions 140A, 140B, 140C, and140D represented, but any suitable number of regions may be used. Insome cases, the gamut mapping block 72 may perform an initial analysisto determine which subsets of the intermediary image data have similarregional properties, such as brightness levels, saturation values, huevalues, color distributions, or the like. The regions 140 may includenon-equal portions (e.g., regionals of varying dimensions or sizes)and/or may be based on regional properties of the input image data 90,and may be selected to decrease an average amount of variance of atarget parameter over the resulting subset of image data. This mayinvolve the gamut mapping block 72 comparing a difference between adetermined average hue value and a determine maximum (or minimum)average hue value to a threshold amount of difference to determine ifthe difference is less than (or greater than and/or equal to) to thethreshold amount of difference (e.g., 5% difference in value, 1%difference in value), and thus is suitable. A similar analysis may beused for other color parameters, such as brightness values, RGB colorvalues corresponding to one or more pixels, saturation, luminance, orthe like, and/or based on a histogram of the image data. It should beunderstood that these are merely example of suitable variations todetermining the regions, and that different and/or many other factorsmay be considered when defining the regions.

Computations performed at block 142 may be separate computationsperformed independent of each other, such that data generated and/oranalysis performed on the region 140A is independent of the sameoperations performed on the region 140B. These computations of portion142 may be performed in serial or in parallel. Performing thesecomputations in parallel may reduce the time spent transforming theimage data. Furthermore, the computations performed at the portion 142may also be improved (e.g., performed using operations that consume lessresources) since some of the computations may converge and/or executerelatively faster over a smaller dataset than when performed over alarger dataset. For example, color gamut mapping operations associatedwith the computations performed at the portion 142 may includeperforming interpolation computations and/or linear transformations thatmay be relatively resource intensive (e.g., when compared to otherprocessing operations), and thus may benefit from relatively reduceddatasets. Indeed, some computations performed may include the gamutmapping block 72 determining roots by iteratively applying computations,such as a Newton-Raphson analysis and/or other root determinationcomputation, to data of the regions 140. The regions 140 may representrelatively smaller sets of data that, in some cases, are characterizedby relatively less variance than the entire set of data received as theinput image data 90. Computations performed by the gamut mapping block72 may converge faster when performed over smaller sets of the inputimage data 90 than when performed over the entire set, thereby improvingcomputing operations.

Divisions used by the gamut mapping block 72 to generate the regions 140may be logical divisions. In this way, the total dataset may remainintact during the transform operations of portion 142). For example,during the sub-region division operations of portion 138, the gamutmapping block 72 may determine and define processing ranges for thedata, such that any computations may be performed over subsets of datacorresponding to the processing ranges of the regions 140.

Once computations conclude and/or the gamut mapping block 72 hassuitably transformed the input image data 90 to be compatible with acolor space used by the electronic display 12 (e.g., third color space),the gamut mapping block 72 may join the divided regions 140 by rejoiningthe regions 140 of transformed image data (e.g., transformed sub-regionof image data) or by removing logical divisions when processing (e.g.,operations of portion 144) to generate transformed intermediary imagedata. The gamut mapping block 72 may convert the transformedintermediary image data into the output image data 92 in a color spaceused by the electronic display 12 (e.g., third color space). Referringback to FIG. 6, after any remaining processing is performed to theoutput image data 92, the display pipeline 38 may output the image datato the output buffer 68 for use by the display driver 42 in presentingan image frame. It is noted that transformations to the second colorspace may be applied to the image data processed as intermediary imagedata. Once the input image data 90 is converted to the hybrid colorspace, the input image data 90 may be referred to as “intermediary imagedata.” A reverse of the conversion applied to the input image data 90may transform the intermediary image data to generate the output imagedata 92. Processing and/or adjustments made to the intermediary imagedata while in the hybrid color space may compensate for differencesbetween the first color space and the second color space.

FIG. 10 is a diagrammatic representation of operations performed by thegamut mapping block 72 to divide a first color space into sub-spaces.For example, the first color space may be defined based at least in parton data represented by cube 166. The gamut mapping block 72 may use thesub-spaces when determining a color mapping relationship for arespective region, such as to determine a color mapping relationship tobe used to transform image data corresponding to the region of the cube166 to data compatible with a hybrid color space.

Indeed, the gamut mapping block 72 may generate color mappingrelationships 168 by dividing data indicative of the first color space(e.g., a source gamut) into sub-spaces 170 (e.g., sub-regions). Thegamut mapping block 72 may apply a respective linear transformation oneach sub-space 170, such as to determine a transform (e.g., the colormapping relationships 168). By applying the generated color mappingrelationships 168, data for a respective pixel may be converted from afirst color space to data for the respective pixel of a second colorspace representation. For example, the data may be converted directlyfrom the first color space (e.g., RGB color space) to the hybrid colorspace, from the hybrid color space to the second color space (e.g., RGBcolor space), and/or from the first color space (e.g., RGB color space)to the second color space (e.g., RGB color space) using the transformsrepresented by the color mapping relationships 168.

For example, the gamut mapping block 72 may divide a color space intomultiple sub-spaces 170, such as sub-space 170A, sub-space 170B, and soon. Although eight sub-spaces 170 are shown, any suitable number ofsub-spaces may be used to divide data characterizing a color space, suchas the first color space. The gamut mapping block 72 may determine acolor mapping relationship 168 for a respective sub-space 170 of thefirst color space independent of a determination of a color mappingrelationship 168 for the other sub-spaces 170 of the first color space.For example, the color mapping relationship 168A may correspond to thesub-space 170B. The first color space may be represented as the cube 166(e.g., one axis 172 for R values, one axis 174 for G values, one axis176 for B values) divided into eight sub-spaces 170. In this way, thecube 166 may be defined from 0 to 255 for each axis. When the gamutmapping block 72 divides the cube 166 into eight sub-spaces 170, eachsub-space 170 corresponding to a subset of potential value combinations(e.g., one region 170A corresponding to 0 to 127 for R values andanother region 170B corresponding to 127-255 for R values) that imagedata may represent as a particular combination of a R value, a G value,and a B value of the first color space, and thus corresponding to a datapoint plotted within the cube 166.

As described above, the combination of RGB values may map differently inthe first color space when compared to a second color space. Thus, thegamut mapping block 72 may generate a color mapping relationship for thefirst color space to transform the image data from the first color spaceto the second color space. However, generating of the color mappingrelationship may be improved when generating the color mappingrelationships 168 for each of the eight subspaces 170 as opposed togenerating a color mapping relationship for the first color space as awhole. As one may appreciate, it is generally more efficient to generatea linear and/or non-linear relationship for a smaller set of data and/orfor data with less outliers (or variance) than for a dataset that islarger and/or with more outliers. Thus, generation of the color mappingrelationship may improve since less computing resources may be used whenthe gamut mapping block 72 generates the color mapping relationships 168for each of the eight regions 170 separately and/or in parallel. Thegamut mapping block 72 generating the color mapping relationships 168for each of the eight regions 170 may improve on mapping operationssince equation roots of the color mapping relationship (e.g., slopesand/or characteristics) may be faster to converge, and thus lessresource intensive, when determined for each of the eight regions 170relative to performing a color mapping relationship determination forthe entire cube 166 (e.g., entire color space).

It is noted that the gamut mapping block 72 may transform the firstcolor space to the second color space before applying the color mappingrelationships 168. The processes may be combined to permit applying of arespective transform of many determined transforms (e.g., color mappingrelationships 168) to a respective region of the sub-spaces 170.Referring back to block 118 of FIG. 8, determination of the transformmay involve the gamut mapping block 72 identifying the particular regionof the sub-spaces 170 that corresponds to one or more regions 140 of theinput image data 90. Indeed, the gamut mapping block 72 may classify theinput image data 90 into one or more sub-spaces 170, and each sub-space170 may have a respective transform to be applied to map between the twocolor spaces. This may permit the gamut mapping block 72 to transformportions of the input image data 90 according to a respective colormapping relationship defined for the color space.

To apply the color mapping relationships 168 to the input image data 90,the gamut mapping block 72 may transform the input image data 90 fromthe first color space to the second color space (e.g., hybrid colorspace). The gamut mapping block 72 may then apply a corresponding of thecolor mapping relationships 168 to the transformed image data.Application of the corresponding color mapping relationship 168 maytransform the image data from the second color space to the third colorspace (e.g., display device color space). In this way, both determiningof the color mapping relationships 168 and transformation of the inputimage data 90 for a present image frame (or future image frame) may beperformed at least in part by using regional divisions of the dataset.

The gamut mapping block 72 may apply color mapping relationships 168 totransform the input image data 90 from the first color space to thethird color space without first transforming image data from the firstcolor space to the second color space, such as may occur in a bypassmode. The bypass mode may be a mode set by a controller of the displaypipeline 38 (e.g., by setting a flag in a register, by transmitting acommand to the gamut mapping block 72) when it is desired to processimage data faster, such as to process the image data before a targetpresentation time and/or other timing considerations. The bypass modemay use color mapping relationships 168 that permit such a bypass, suchas color mapping relationships 168 that are used to convert the inputimage data 90 to the output image data 92 without the hybrid colorspace. A flag stored in a register or otherwise received by the gamutmapping block 72 may indicate the bypass mode. When the gamut mappingblock 72 determines that the flag has a first state corresponding to abypass mode being activated, the gamut mapping block 72 may apply one ormore transforms (e.g., apply any associated color mapping relationships168) to the input image data 90 in the first color space to generate theoutput image data 92 of the third color space without first transformingthe input image data 90 to a third color space (e.g., without firstgenerating the intermediary image data).

The gamut mapping process (e.g., color space conversion process)described herein involves converting image data from a first color spaceto a third color space to provide a perceivably uniform appearance ofthe image data when presented in both the first color space and thethird color space. The gamut mapping process may also be performed tocorrect for differences in color spaces used by different components ofa same device, such as different components of the electronic device 10,and/or to correct for differences in a color space of the electronicdevice 10 over time. For example, color spaces may change over time dueto changes in operating conditions and/or aging of one or morecomponents of the electronic device 10. Furthermore, in some cases,color spaces may change between an image source, such as the applicationprocessor 52, and a display device 12. In some cases, one electronicdevice 10 may have multiple electronic displays 12, where one or more ofthe multiple electronic displays 12 may use a different color space fromthe color space used by the image source.

In some embodiments, the sub-spaces 170 of the color space (e.g.,represented by the cube 166) may be divided into any suitable shape,such as triangular prisms, tetrahedrons, or the like. Furthermore, thegamut mapping block 72 may use any suitable process, such as hyperplaneequations and/or a series of if-then statements in an instruction setstored in memory and executable by the gamut mapping block 72 and/or acontroller of the display pipeline 38, to divide (e.g., logicallydivide) the color space in the sub-spaces 170. The same may apply todividing the image data into regions. Indeed, in some cases, the regionsmay not be contiguous, and two unconnected or non-adjacent (e.g.,logically unconnected, logically non-adjacent) portions of the cube 166and/or image data, may be divided in a same region.

It is noted that these systems and methods described herein may be usedto provide displays 12 accessible by users with abnormal human colorvision, or color vision deficiencies (CVD). For example, using themethods to convert the image data from a first color gamut to a secondcolor gamut may permit the conversion of image data from a color gamutassociated with an image source for normal, typical or otherwiseexpected human vision to image data to be used to drive a display devicewith a color gamut to enable operations with abnormal or otherwiseatypical human color vision, or color vision deficiencies (CVD) to havea similar or otherwise suitable viewing experience. Thesetransformations that use defined sub-region methods may improve thereadability of color information on display devices for users with CVD,as well as perceived image quality of these users, by modifying thecolors desired to be adjusted without having to adjust each color oreach portion of the image data. Indeed, these methods may be applied inlieu of a global adjustment, permitting more selective adjustmentsbetween color spaces.

Thus, the technical effects of the present disclosure include a gamutmapping block to perform color space conversion operations to improveimage presentation on a display. The gamut mapping block may reducecomputing resources (e.g., processing resources, time) consumed whenperforming color space conversion operations by dividing datasets toreduce an amount of data being used to transform image data betweencolor spaces and/or to determine a color mapping relationship. Forexample, the gamut mapping block may reduce a size of a color space ofwhich color mapping relationships are determined by dividing a colorspace in to sub-spaces for use when determining respective color mappingrelationships, as opposed to one color mapping relationship for thecolor space. Dividing the size of the dataset may reduce an amount ofcomputing resources consumed since these computations, such as rootdeterminations, may be relatively complex determinations that benefit,both in processing time and processing accuracy, from simplifieddatasets.

The specific embodiments described above have been shown by way ofexample, and it should be understood that these embodiments may besusceptible to various modifications and alternative forms. It should befurther understood that the claims are not intended to be limited to theparticular forms disclosed, but rather to cover all modifications,equivalents, and alternatives falling within the spirit and scope ofthis disclosure.

The techniques presented and claimed herein are referenced and appliedto material objects and concrete examples of a practical nature thatdemonstrably improve the present technical field and, as such, are notabstract, intangible or purely theoretical. Further, if any claimsappended to the end of this specification contain one or more elementsdesignated as “means for [perform]ing [a function] . . . ” or “step for[perform]ing [a function] . . . ”, it is intended that such elements areto be interpreted under 35 U.S.C. 112(f). However, for any claimscontaining elements designated in any other manner, it is intended thatsuch elements are not to be interpreted under 35 U.S.C. 112(f).

1. An electronic device, comprising: an electronic display comprising aplurality of display pixels configured to present an image based onimage data; and a display pipeline comprising image processing circuitrycoupled to the electronic display, wherein the display pipeline isconfigured to: receive first image data from an image source, whereinthe first image data corresponds to a first color space; determine thata second color space used by the electronic display is associated with afirst sub-space and a second sub-space of a third color space, whereinthe first sub-space corresponds to a first range of three colorcomponent data values of the third color space, and wherein the secondsub-space corresponds to a second range of three color component datavalues of the third color space distinct from the first range of threecolor component data values; determine that a three color component datavalue of the first image data corresponds to the first sub-space basedat least in part on the three color component data value of the firstimage data corresponding to the first range of three color componentdata values; select a color mapping relationship associated with thefirst sub-space from a plurality of color mapping relationshipsassociated with different respective sub-spaces of the third color spacebased at least in part on determining that the three color componentdata value corresponds to the first sub-space, wherein the color mappingrelationship defines a transform to use to generate intermediary imagedata in the third color space from at least the three color componentdata value; apply the color mapping relationship to the three colorcomponent data value of the first image data to generate intermediaryimage data; convert the intermediary image data from the third colorspace to the second color space; and transmit the converted intermediaryimage data to the electronic display configured to emit light accordingto the converted intermediary image data.
 2. The electronic device ofclaim 1, wherein the electronic display comprises a liquid crystaldisplay, a light-emitting diode display, an organic light-emitting diodedisplay, or a digital micromirror device display, or any combinationthereof.
 3. The electronic device of claim 1, wherein the displaypipeline is configured to, when determining the color mappingrelationship: divide the first color space to generate a plurality ofsub-regions, wherein the plurality of sub-regions comprise non-equalportions of the first color space based on regional properties of inputimage data; perform iteration-based computations on the sub-regions ofthe plurality of sub-regions to generate a plurality of results; anddetermine the plurality of color mapping relationships based at least inpart on the plurality of results.
 4. The electronic device of claim 1,wherein the display pipeline is configured to, when determining thecolor mapping relationship: divide the first color space to define aplurality of sub-regions of three color component data values to beclassified into respective sub-spaces of the second color space; for arespective sub-region of three color component data values, compare dataof the respective sub-region of three color component data values todifferent respective ranges of three color component data values of thedifferent respective sub-spaces of the third color space using iterativemethods to determine that the respective sub-region of three colorcomponent data values corresponds to the first sub-space; apply thetransform of the color mapping relationship defined for the firstsub-space to the respective sub-region to generate a transformedsub-region; and generate second image data based at least in part on aplurality of transformed sub-regions.
 5. The electronic device of claim4, wherein applying of the transform is started at a same start time foreach sub-region.
 6. The electronic device of claim 1, wherein the firstcolor space comprises a first red-green-blue color space and the secondcolor space comprises a second red-green-blue color space different fromthe first red-green-blue color space corresponding to a color spacesuitable for viewing by a user having a color vision deficiency (CVD).7. The electronic device of claim 1, wherein the display pipeline isconfigured to: generate the intermediary image data at least in part by;dividing the third color space to generate the sub-spaces; classifyingthe first image data with iterative methods to determine which of therespective sub-spaces of the sub-spaces that each respective three colorcomponent data value of the first image data is in, wherein each of thesub-spaces corresponds to a respective color mapping relationship forthe third color space; after classifying each three color component datavalue of the first image data into one or more sub-spaces, generatingthe intermediary image data at least in part by applying the transformof the respective color mapping relationship to each respective threecolor component data value of the first image data based at least inpart on which respective sub-space of the one or more sub-spaces thatthe respective three color component data value was classified; andgenerating second image data based on converting the intermediary imagedata to the second color space, wherein the second image data istransmitted as the converted intermediary image data to the electronicdisplay.
 8. The electronic device of claim 7, wherein the third colorspace comprises a hybrid color space, a luminance-first component-secondcomponent (YCbCr) color space, a uniform color space associated withaxes corresponding to luminance, chroma, or hue, or any combinationthereof.
 9. The electronic device of claim 1, wherein the displaypipeline is configured to: divide the first image data to generate aplurality of sub-regions of data; and determine the plurality of colormapping relationships based on respective alignment of the plurality ofsub-regions with sub-spaces of the second color space, wherein theplurality of color mapping relationships comprises the color mappingrelationship.
 10. The electronic device of claim 9, wherein applying thecolor mapping relationship to the first image data involves classifyinga plurality of sub-regions of the first image data into one or moresub-spaces of the second color space.
 11. A method, comprising:receiving first image data from an image source into image processingcircuitry, wherein the first image data corresponds to a first colorspace; determining that a subset of three color component values of thefirst image data correspond to a first sub-space of a second color spacebased at least in part on the subset of three color component valuescorresponding to a first range of three color component valuescorresponding to the first sub-space; selecting a transform associatedwith the first sub-space from a plurality of transforms associated withdifferent respective sub-spaces of the second color space based at leastin part on determining that the subset of three color component valuesof the first image data correspond to the first range of three colorcomponent values of the first sub-space; applying the transform to thesubset of three color component values of the first image data togenerate intermediary image data in the second color space; convertingthe intermediary image data from the first color space to a third colorspace used by an electronic display; and transmitting the convertedintermediary image data to the electronic display to drive lightemission according to the converted intermediary image data.
 12. Themethod of claim 11, wherein applying the transform comprises convertingthe first image data from the first color space to the second colorspace before applying the transform to the subset of the three colorcomponent values of the first image data.
 13. The method of claim 12,wherein: generating the intermediary image data comprises: convertingeach three color component value of the first image data from the firstcolor space to the second color space; and applying the transform to thefirst image data to generate intermediary image data used to convert thefirst image data from the first color space to the third color spacecomprises: dividing the first color space to generate a second pluralityof sub-spaces; and performing an iteration-based computation on eachsub-space of the second plurality of sub-spaces to identify that thefirst image data corresponds to the first sub-space.
 14. The method ofclaim 11, comprising applying the transform to the first image dataafter converting the first image data to a luminance-firstcomponent-second component (YCbCr) representation corresponding to thesecond color space.
 15. A non-transitory, computer-readable mediumcomprising instructions that, when executed by a processor, cause theprocessor to perform operations comprising: receiving input image datacorresponding to a first color space; determining that a three colorcomponent value of the input image data corresponds to a first sub-spaceof a second color space based at least in part on the three colorcomponent value of the input image data corresponding to a range ofthree color component values defined as corresponding to the firstsub-space; determining a transform to apply from a plurality oftransforms associated with different respective sub-spaces of the secondcolor space based at least in part on determining that the three colorcomponent value of the input image data corresponds to the firstsub-space; applying the transform to the three color component value ofthe input image data to generate intermediary image data in the secondcolor space; and convert the intermediary image data from the secondcolor space to a third color space used by a display to generate outputimage data used by the display to present an image frame correspondingto the input image data.
 16. The non-transitory, computer-readablemedium of claim 15, wherein the operations for generating the outputimage data comprise generating converted image data at least in part byconverting the input image data from the first color space to the secondcolor space using iterative methods.
 17. The non-transitory,computer-readable medium of claim 15, comprising instructions that, whenexecuted by the processor, cause the processor to perform operationscomprising: generating a plurality of sub-regions from the input imagedata at least in part by: converting the input image data to aluminance-first component-second component (YCbCr) representationcorresponding to the second color space.
 18. The non-transitory,computer-readable medium of claim 17, wherein the output image datacomprises image data having equal hue, luminance, color values, or acombination thereof, relative to the input image data, and wherein theplurality of transforms are configured to process out-of-gamut colors.19. The non-transitory, computer-readable medium of claim 15, whereinthe operations of determining the transform to apply to the input imagedata involve usage of a binary tree.
 20. The non-transitory,computer-readable medium of claim 15, the operations comprising: readinga flag from a register of a display pipeline, wherein the flag has afirst state; and in response to reading the flag having the first state,determining to apply the transform to the input image data in the firstcolor space without first transforming the input image data to thesecond color space.